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HIGH CAPACITY ROUTER HAVING REDUNDANT COMPONENTS 

BACKGROUND OF THE INVENTION 

A. Field of the Invention 

The present invention relates generally to routing systems, and, more 
particularly, to highly reliable routing systems. 

B. Description of Related Art 

Conventional networks typically include routers that route packets from 
one or more sources to one or more destinations. A packet is a variable size 
record that is transmitted through a network. A router is a switching device that 
receives packets containing data and control information at input ports, and, 
based on destination or other information included in the packets, routes the 
packets to appropriate output ports that lead to either the next router in the 
packet's journey or to the packet's final destination. Routers determine the 
proper output port for a particular packet by evaluating header information 
included in the packet. 

Routers come in various sizes and capacities. A low capacity, relatively 
inexpensive router, for example, may be used in a home network to route data 
between three or four personal computers. At the other end of the router 
spectrum are high-performance routers commonly used by telecommunication 
companies and internet service providers to provide feature rich, high bandwidth 
packet routing. High-performance routers may process packets for many 
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thousands of different end users. Accordingly, it is an important feature of these 
routers that they do not fail. 

Therefore, it is desirable to increase the reliability of a router. This need is 
particularly acute in high-performance routers. 

5 SUMMARY OF THE INVENTION 

The present invention addresses the need to increase the reliability of a 
^ router by providing a router having redundant components. 
Cj One aspect of the present invention is directed to a router for routing 

s ~ 

m packets in a network, the router includes a number of elements, including 

W 10 processing components configured to determine destination information for the 

: packets and routing engines configured to maintain routing tables that contain 

packet routing information. One of the processing components is an active 
h processing component and the other of the processing components are non- 
active processing components. One of the routing engines is an active routing 
15 engine and the other of the plurality of routing engines are non-active routing 
f engines, at least one of the non-active routing.engines.re ceivin g information fro m 
I the a ctive routing engine indicating i whether Jhe_actjye routing engine is 
| functioning. The non-active routing e ngine asse rts itself as the active routing 
; engine when the non-active routing engine fails to receive the information from 
20 v the active routing engine. 

A second aspect of the present invention is directed to a router including a 
first routing engine, a second routing engine, and a redundancy controller circuit. 
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The redundancy controller is connected to the first and second routing engines 
and configured to reset one of the first and second routing engines and to allow 
the other of the first and second routing engines to become an active routing 
engine. 

5 Further aspects of the present invention are directed to methods for 

controlling a router. One method includes setting a first routing engine of the 
router to an active state, the first routing engine communicating with a packet 
forwarding engine while in the active state. Additionally, the method sets a 
second routing engine to a standby state, the second routing engine, when in the 
10 standby state, monitoring the first routing engine for a failure. The second 

routing engine assumes the active state when the second routing engine detects 
t£ a failure in the first routing engine, 
hi 

0 BRIEF DESCRIPTION OF THE DRAWINGS 

u 

The accompanying drawings, which are incorporated in and constitute a 
15 part of this specification, illustrate an embodiment of the invention and, together 
with the description, explain the invention. In the drawings, 

Fig. 1 is a diagram illustrating the high-level functional components of a 

router; 

Fig. 2 is a diagram illustrating a more detailed implementation of a router 
20 consistent with the present invention; 

Fig. 3 is a diagram illustrating a more detailed view of the redundancy 
controller for the router shown in Fig. 2; 
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Fig. 4 is a diagram illustrating a more detailed view of the redundancy 
switch for the router shown in Fig. 2; 

Figs. 5 and 6 are flow charts illustrating methods, consistent with the 
present invention, for powering-up the router; 

Fig. 7 is a flow chart illustrating methods, consistent with the present 
invention, for performing normal operation of the router; and 

Figs. 8A-8C are diagrams illustrating the loopback multiplexer for the 
router shown in Fig. 2. 



DETAILED DESCRIPTION 
The following detailed description of the invention refers to the 
accompanying drawings. The same reference numbers in different drawings 
identify the same or similar elements. Also, the following detailed description 
does not limit the invention. Instead, the scope of the invention is defined by the 
appended claims and equivalents. 

As described herein, a router includes multiple routing engines (REs) and 
packet processing components. During operation, one of the routing engines 
and one of the processing components act as a redundant backup component. 
A redundant controller circuit facilitates a reset of the router, through which an 
active routing engine takes control of the system. 

Fig. 1 is a diagram illustrating, at a high-level, functional components of an 
exemplary router 100. In general, router 100 receives incoming packets 110, 
determines the next destination (the next "hop" in the network) for the packets, 
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and outputs the packets as outbound packets 1 1 1 on physical links that lead to 

the next destination. In this manner, packets "hop" from router to router in a 

network until reaching their final destination. 

Router 100 includes routing engine 105 and a packet forwarding engine 
5 (PFE) 106. Routing engine 105 may maintain one or more routing tables (RTs) 

115 and a forwarding table (FT) 116. Through routing tables 115, routing engine 

105 consolidates routing information that the routing engine learns from the 
O routing protocols of the network. From this routing information, the routing 

protocol process may determine the active routes to network destinations and 
^! 10 install these routes into forwarding table 116. Packet forwarding engine 106 may 

consult forwarding table 116 when determining the next destination for incoming 

packets 110. 

fy Fig. 2 is a diagram illustrating, in more detail, an implementation of router 

O 100 consistent with an aspect of the present invention. Routing engine 105 is 

: — : 

15 implemented as two redundant routing engines, labeled as routing engine RE 
201 and RE 202. Redundancy controller 203 is connected to REs 201-202 and 
facilitates the selection of the active routing engine 201 or 202. At any given 
time, only one of REs 201-202 actively provides a forwarding table to packet 
forwarding engine 106. The other, non-active, routing engine acts as a standby 

20 routing engine. 

In addition to having redundant REs 201-202, router 100 includes 
redundant processing components 205 and 206. Processing components 205 
and 206 may perform the high-level functions of packet forwarding engine 106, 
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including determining the correct destination output port for the input packets. 
More particularly, processing components 205 and 206 may store the forwarding 
table constructed by RE 201 or 202 and receive the packet control information 
from packet manager 220. The processing components may then use the 
5 forwarding tables to lookup the output port for the packet based on its control 
information. 

Redundancy switch 207 connects processing components 205 and 206 to 
packet manager 220 and to redundancy controller 203. Destination information, 
Cj determined by processing component 205 or 206, is transmitted to packet 
m 10 manager 220, through redundancy switch 207. Packet manager 220 may then 

% X \ 

Ln transmit the packet on its appropriate output ports, as determined by processing 
f component 205 or 206. 

ST; Packet manager 220 generally handles input/output functions related to 

q the incoming and outgoing packets. More particularly, packet manager 220 may 
15 receive the incoming packets and forward the packet control information (also 
called header information) to redundancy switch 207. In order to conserve 
bandwidth in transmitting the header information to redundancy switch 207 and 
processing components 205-206, packet manager 220 may strip the packet 
header information from the packet body. The body may be stored by packet 
20 manager 220, with only the header being transmitted to redundancy switch 207. 
The processed header, including its destination port, may subsequently be 
received by packet manager 220, which reassembles and transmits the packet. 
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Packet manager 220 may include a number of physical interface slots 
225, each of which may include one or more physical interfaces. A physical 
interface slot 225, for example, may include an Ethernet card and an optical 
interface card such as a card supporting the OC-12 optical transmission 
5 standard. Packets received over one physical interface, after processing, may 
be transmitted over another one of the physical interfaces. In this manner, router 
1 00 can support packet routing over a network constructed using heterogeneous 
transmission components. 

S3. 

y 

g The components of Fig. 2 communicate with one another via a number of 

n 10 signal and data paths. As shown, REs 201-202 and processing components 

fl 205-206 include Ethernet ports 230-233 through which the routing engines and 

"i i 

processing components transfer data. In addition to the Ethernet connections, 
y signal lines 236 and 237 are shown, over which redundancy control information 
□ is transmitted between the various components shown in Fig. 2. 

15 Although Ethernet ports 230-233 were described in implementing the 

data paths in Fig. 2, other communication technologies may alternatively be 
used. 

Fig. 3 is a diagram illustrating a more detailed view of redundancy 
controller 203. Redundancy controller 203 includes two servant circuits 301 and 
20 302, that, based on signals from REs 201 and 202, activate switches 303-306. 
The output of switches 303-306 dictates the state of processing component 205, 
processing component 206, redundancy switch 207, and loopback multiplexer 
(MUX) 310. Loopback MUX 310 appropriately routes data flow between either 
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RE 201 or RE 202, and redundancy switch 207. Signal lines 315-320, which 
were broadly illustrated in Fig. 2 as lines 236, transmit redundancy control 
information within router 100. The function of these lines will be explained in 
more detail below. 



207. Redundancy switch 207 connects one of processing components 205-206 
to packet manager 220 and REs 201-202. This connection is functionally 
illustrated in Fig. 4 using switches 401-403, each under control of the signal line 
315. Switches 401-403 operate in one of two modes. In the first mode, switches 

10 401-403 may connect processing component 205 to REs 201-202 and packet 
manager 220. In the second mode, switches 401-403 may connect processing 
component 206 to REs 201-202 and packet manager 220. Bus 407 directly 
connects processing components 205 and 206, allowing the standby processing 
component to communicate with and potentially store the present state of the 

15 active processing component. If the active processing component fails, the 
standby processing component can then immediately assume operation. 

The operation of router 100 as it relates to the redundant routing engine 
and processing component will now be discussed. 

Router 100, when turned on, performs a power-up sequence to initially 

20 come on-line. During this initialization process, router 100 decides which of the 
redundant routing engines 201-202 and processing components 205-206 to use. 
The user or manufacturer may pre-configure one of REs 201-202 and 
processing components 205-206 to be the preferred active component at power- 
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Fig. 4 is a diagram illustrating a more detailed view of redundancy switch 
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up. The routing engine and processing component not configured as the 
preferred active components are the preferred standby components. In this 
situation, if all the components come on-line without errors, the preferred active 
components take control of the system. 

Fig. 5 is a flow chart illustrating methods consistent with the present 
invention for powering-up router 100. On power-up, REs 201 and 202 both 
perform their initial power-up sequence and, if power-up is successful, come on- 
line in standby mode. (Act 501). At this time, loopback MUX 310, which 
operates in one of two modes, is in its first mode, "mode 1." Figs. 8A and 8B 
illustrate "mode 1" and "mode 2," respectively, of loopback MUX 310. As shown, 
in mode 1 (Fig. 8A), REs 201 and 202 are connected together through their 
Ethernet connections. After successfully coming on-line in standby mode, each 
RE 201 and 202 consults its pre-configured preferr ed setting to determine 
whether the RE is the active or standby RE. ( Act .5 02)^ 



Based on their pre-configured settings, REs 201 and 202 negotiate their 
actual state over the communication line through loopback MUX 310. (Act 503). 
Table I is an exemplary logic table defining possible negotiation rules. As shown 
in Table I, if one of the routing engines does not come on line (i.e., it is disabled, 
not present, or otherwise faulty), the other routing engine assumes the active 
status. In this situation, the RE that is on-line may wait a predetermined time 
period before assuming that the other routing engine is not going to come on- 
line. Once an RE takes control after assuming that the other RE is disabled and 
is not going to come on-line, the RE that takes control may not relinquish control 
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even if the off-line RE eventually comes on-line and is the pre-configured 
preferred RE. 



Table 1 


Initial Configuration: 


Result of Negotiation: 


RE 201 


RE 202 


RE 201 


RE 202 


Active 


Active 


Active 


Standby 


Active 


Standby 


Active 


Standby 


Active 


Disabled (e.g., not 
present) 


Active 


Disabled 


Standby 


Active 


Standby 


Active 


Standby 


Standby 


Active 


Standby 


Standby 


Disabled 


Active 


Disabled 


Disabled 


Active 


Disabled 


Active 


Disabled 


Standby 


Disabled 


Active 


Disabled 


Disabled 


Disabled 


Disabled 



After the REs negotiate which is to be the active RE and which is to be the 
standby RE, the active RE asserts its control of router 100 by signalling as much 
to servant circuit 301 or servant circuit 302 through signal lines 317 (RE 201 
active) or 318 (RE 202 active). (Act 504). In response, the corresponding 
servant 301 or 302 initiates a "reset" operation that establishes the active routing 
engine's control of router 100. 
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In response to a reset operation initiated by RE 201, servant circuit 301 
may activate line 320, which resets RE 202 and servant circuit 302. (Act 505). 
Resetting servant circuit 302 causes it to source a logic high value (i.e., a logic 
"1") to switches 303-306. Each of switches 303-306 may be configured as a 
5 switch that outputs one of its two inputs. One possible implementation for 

switches 303-306 is as a logical AND gate. With this logical AND configuration, 
when a first input to the switch is logic high, the output of the switch is equal to 
the second input. Accordingly, when servant circuit 302 sources logic high 
values to switches 303-306 after it is reset, switches 303-306 effectively act as 
10 pass through circuits for the values received from servant circuit 301 . In this 
manner, switches 303-306 and servants 301 and 302 implement "deadlock 
recovery" of the REs 201-202, because even if an RE fails, the redundant RE is 
guaranteed the ability to control the router 100 by resetting the corresponding 
servant circuit. 

15 Servant circuit 301 may then change the operational mode of loopback 

MUX 310, through switch 304, to mode 2. (Act 506). As shown in Fig. 8B, in 
mode 2, loopback MUX 310 forwards data from REs 201 and 202 to redundancy 
switch 207. The active RE, RE 201 , resets processing component 205 and 206 
through switches 305 and 306. (Act 507). Finally, RE 201 initiates 

20 communication with one of components 205 or 206. (Act 508). Fig. 8C is a 
logical view of a possible implementation of loopback MUX 310. As shown, the 
switch logic in loopback MUX 310 can be simply shown as a pair of switches 
under the control of a single control signal line 316. 



n 



^} Docket No.: 0023-0016 

Fig. 6 is a flow chart illustrating Act 508, in which the active RE (RE 201) 
initiates communication with one of the processing components, in additional 
detail. RE 201 begins by determining the presence of processing components 
205 and 206. (Act 601). This may be accomplished, for example, by detecting 
5 the presence of a pin on the processing components. RE 201 next exchanges 
information with each detected processing component to determine the 
operability of the processing components. (Act 602). As with REs 201 and 202, 
the processing components 205 and 206 may also be associated with a pre- 
configured default state stating whether the processing component should be 

10 brought on-line as an active or backup processing component. RE 201 

determines the preferred state for each of the operating processing components. 
(Act 603). The preferred state may be, for example, pre-stored in each RE or 
transmitted to the RE by the processing component when it initially exchanges 
information with the RE in Act 602. Based on the information gathered in Acts 

15 601, 602, and 603 (i.e., the presence, operability, and preferred state of each 
processing component), the RE 201 determines which processing component to 
make active and which to make standby. (Act 604). This decision can be made 
with a pre-stored decision table similar to Table 1. Through switch 303, RE 201 
may control redundancy switch 207 to connect the active processing component 

20 205 or 206. (Act 605). 

Although the techniques discussed-above for powering-up router 100 
assumed. RE 201 was the active routing engine, the methods would be similar 
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when RE 202 is the active RE, as redundant controller 203 and redundancy 
switch 207 are symmetrical with respect to REs 201 and 202. 

Fig. 7 is a flow chart illustrating methods consistent with the present 
invention for operating router 100 during normal operation (i.e., after power-up). 
5 In general, during normal operation, the active routing engine 201 or 202 

interacts with the active processing component 205 or 206 and packet manager 
220. If the active routing engine fails, the standby routing engine takes control of 
^ redundancy controller 203. The standby routing engine may constantly maintain 
^ a recent copy of the forwarding table 116 along with any other required state 
m 10 information, allowing the standby router to immediately take control of the system 
y] in a transparent or near transparent manner relative to the external operation of 

m 

f router 100. Such state information can be exchanged while in the normal 

operation state (loopback MUX 310 "mode 2") through the Ethernet connection 
U leading to redundancy switch 207 and processing components 205 and 206. 
15 Alternatively, the standby router may be held in a more dormant state, and thus 
require more time to come fully on-line during a control exchange. 

The active RE and the standby RE exchange, at predetermined intervals, 
status information ("heartbeat" messages) that informs the standby RE that the 
active RE is functioning properly. (Act 700). If the standby RE fails to receive a 
20 heartbeat message from the active processor, it assumes the active processor is 
malfunctioning. (Acts 701 and 702). In this situation, the standby RE may reset 
the redundancy controller 203 by activating signal line 317 (RE 202) or 318 (RE 
201), (Act 703), causing a reset operation to begin, as described above with 
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reference to Acts 505-508 of Fig. 5. As previously stated, a reset operation 
causes the corresponding servant circuit 301 or 302 to reset the other servant 
circuit and the other RE, thus transferring control to the resetting RE. 

Additionally, during normal operation, the active RE continuously monitors 
5 the active processing component. If the active processing component stops 
functioning, and a standby processing component is available, the active RE 
makes the standby processing component active. 

Although router 100 is illustrated having two REs and two processing 
components, one of ordinary skill in the art will recognize that the above- 
10 described concepts could be extended to cover more than one extra RE and/or 
processing component. 

The foregoing description of preferred embodiments of the present 
invention provides illustration and description, but is not intended to be 
exhaustive or to limit the invention to the precise form disclosed. Modifications 
15 and variations are possible in light of the above teachings or may be acquired 
from practice of the invention. 

Although described as being primarily implemented in hardware, the 
present invention may be embodied in hardware and/or in software (including 
firmware, resident software, micro-code, etc.). Furthermore, the present 
20 invention may take the form of a computer program product on a computer- 
usable or computer-readable storage medium having computer-usable or 
computer-readable program code embodied in the medium for use by or in 
connection with an instruction execution system. 
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The scope of the invention is defined by the claims and their equivalents. 
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